Zero-shot image classification using coupled dictionary embedding
نویسندگان
چکیده
Zero-shot learning (ZSL) is a framework to classify images that belong unseen visual classes using their semantic descriptions about the classes. We develop new ZSL algorithm based on coupled dictionary learning. The core idea enforce features and attributes of an image share same sparse representation in intermediate embedding space, modeled as shared input space two sparsifying dictionaries. In training stage, we use from number seen for which have access both train dictionaries can represent feature vectors single vector. testing stage absence labeled data, are mapped into attribute by finding joint-sparse representations solely via solving LASSO problem. then classified given also provide attribute-aware transductive formulations tackle “domain-shift” “hubness” challenges ZSL, respectively. Experiments four primary datasets VGG19 GoogleNet features, provided. Our performances 91.0%, 48.4%, 89.3% SUN, CUB, AwA1 datasets, AwA2 57.0%,49.7%, 71.7%, respectively, when used. Comparison with existing methods demonstrates our method effective compares favorably against state-of-the-art. particular, leads decent performance all datasets.2
منابع مشابه
Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Network
We propose a novel framework called SemanticsPreserving Adversarial Embedding Network (SP-AEN) for zero-shot visual recognition (ZSL), where test images and their classes are both unseen during training. SP-AEN aims to tackle the inherent problem — semantic loss — in the prevailing family of embedding-based ZSL, where some semantics would be discarded during training if they are nondiscriminati...
متن کاملTransductive Unbiased Embedding for Zero-Shot Learning
Most existing Zero-Shot Learning (ZSL) methods have the strong bias problem, in which instances of unseen (target) classes tend to be categorized as one of the seen (source) classes. So they yield poor performance after being deployed in the generalized ZSL settings. In this paper, we propose a straightforward yet effective method named Quasi-Fully Supervised Learning (QFSL) to alleviate the bi...
متن کاملZero-Shot Sketch-Image Hashing
Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity search. Providing training and test data subjected to a fixed set of pre-defined categories, the cutting-edge SBIR and cross-modal hashing works obtain acceptab...
متن کاملTransductive Zero-Shot Learning with a Self-training dictionary approach
As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in the following two aspects: 1) capturing the domain distribution connections between seen classes data and unseen classes data; and 2) modeling the semantic int...
متن کاملZero-Shot Learning for Semantic Utterance Classification
We propose a novel zero-shot learning method for semantic utterance classification (SUC). It learns a classifier f : X → Y for problems where none of the semantic categories Y are present in the training set. The framework uncovers the link between categories and utterances through a semantic space. We show that this semantic space can be learned by deep neural networks trained on large amounts...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine learning with applications
سال: 2022
ISSN: ['2666-8270']
DOI: https://doi.org/10.1016/j.mlwa.2022.100278